Add exact-scored O(3) tensor product benchmark - #12
Open
DengZhiyuan-math wants to merge 1 commit into
Open
Conversation
DengZhiyuan-math
marked this pull request as ready for review
July 29, 2026 07:32
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
FINAL ANSWER:line fromPROOF.mdWhy
This is the first small contribution from the tensor-product decomposition benchmark series proposed in #11. It tests whether OpenProver can apply a supplied mathematical rule, justify the result, and emit an exact symbolic decomposition.
The task intentionally uses informal-proof mode rather than per-sample Lean equalities. Encoding each expected decomposition in a Lean theorem target would reveal the answer and reduce many samples to
rflordecide. The deterministic scorer remains the verification authority for this first version.The bundled JSONL is only a reviewable sample. Larger benchmark datasets can be supplied with
--dataset PATHand remain outside the OpenProver repository.Scoring contract
For inputs
l1 p1andl2 p2, the oracle:|l1-l2|throughl1+l2;e*e=e,e*o=o,o*e=o,o*o=e;FINAL ANSWER:marker fromPROOF.md.Wrong parity, order, missing/extra terms, duplicates, malformed syntax, missing markers, and ambiguous markers score zero.
Validation
black --check scripts/run_irreps_tensor_product.py tests/test_irreps_tensor_product_benchmark.pyruff check scripts/run_irreps_tensor_product.py tests/test_irreps_tensor_product_benchmark.pypytest --ignore=tests/test_tui_keys.py -q— 32 passedpython scripts/run_irreps_tensor_product.py --listgit diff --checkThe three excluded interactive TUI tests also fail unchanged on a clean
upstream/masterworktree: two require a real terminal stdin, and one still calls the removedmax_stepssetup argument.Related to #11.